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" ABSTRACT 



The author hypothesized that (a) an analysis of the research literature would 
lead to identifying the behaviors and dispositions associated with sue c es sful 
goal-setting and goal achievement. He further hypothesized that (b) based on 
these data, an instructional package could be constructed to teach children a 
skill-strategy based on selected behaviors and dispositions identified as being 
central to achievement. Following an analysis of the relevant literature, the 

author selected major achievement behaviors and developed Achievement 

^ t ^ 

Competence Training (ACT) based on "those behaviors to instruct learners in 

a strategy for setting and achieving go^ls. The effects of ACT and an alter- 
nate set of instructional materials upon goaKsetting behavicjr, perceived 
locus of control, and self- evaluation were tested in 5- fifth-g rade classrooms 
in each of 33 schools. ACT significantly inci'eased belief in internal control 
.as compared with the alt-ern^tive Treatment aKd an Uninstructed Control 
group. Students using ACT also demonstrated (a.) greater tendency to pre- 
scribe self^rected solutions to problems ; .(b) lower (more realistic) 
personal p.erformance standards for favorablie self-evaluation; and (£) less 
discrepancy between self -p redicted performance and personal standards for 
good performance. In addition to these measurement data, interviews, 
observations, and anecdotes reflected positive results of ACT. Results are 
discussed in. relation to a theoretical modei of achievement in which a^chieve^ 



ment behavior is sustained through covert self- reinforcements . 
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T.EACHING CHILDREN TO USE ACHIEVEMENT BEHAVIORS AND 
• DlSl'().snTONS I' OR SETTING AND ACHIEVING PERSONAL GOALS 

' ■ Z k 
Russell- A. Hill 

HUMANIZING LEARNING PROGRAM 

RESEARCH FOR BETTER SCHOOLS. INC. 

f 

Majximizing student achieve tnent remains the major charge of our pOhlic( 
scliools. Most effo^-ts to enhance achievement consist of nv.w or improved 
techniques or materinlrf for instructing students in specific suhu* I matter. 
Few systrrnatic attempts havp been made tq instruct- ochool-agc children in 
general behaviors associated with successful achi'^vemenf across subject 
areas The present study describes the results of an inst r wcti onal prograni 
based on the hypotheses that general achievement behaviors can be identified 

and taught, ^ - 

^ Theoretical Backg round 

What characte ristics distinguish successful achievers from their less- t 'nevi 
agemates of comparable general ability? Some of th-ese rha r actc ri sitx s 
appear to be specific behavio rs , while others are broad attitudes or disposi- 
tions. One dispositional characteristic associated with achie ment is the 
concept of per.ceived locus of causality for behavior, first introfluced l)y 
Heider (1958-). According t© this concept, individuals can be scaled^on a 
continuum ranging from bolief in internal locus of control (that is, belief 
that one can control and direct one's life) to belief in external locus of 
control (tl;at is, bej^f that external forces control one's life). 
Since then numerous theoreticians have developed reUtcd tlieories for 

1 

achievement in which belief in internal locus of control figures as an essential 
disposition upon wliich achievement binges, A few attempts have been made 



^The work upon whrch this publication is based was perforn^erl [lursu^nt to 
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to enhance achievement by increasing students' perceptions of events as 
"internally" controlled (de Charins, 1972 ;* Lifshitz. 1973: Nowicki K, Barnes 
197J; Pierce, Schauble, & Farkas, 1970; Reimanis, 1970), Tins sense of 
agency, of being able to act and to interact effectively with one's environment, 
correlgites positively with school achievement (Cqleman, Campbell, Hobson, 
McPartland, Alexander, Weinfeld, h York, 1966), Building these skills into 
a student's repertoire may be a powerful new approach for student success. 
In addition, a review of over 90 studies support the contention tl>at a belief 
in internal control is significantly correlated with personal well-being and 
socially desirable behavior (Chapman &f" Hill, 1971; Hill, Chapman, & Wuertzer 
1974), • 

Goal-setting behavior -has been foond to have a positive effect upon achievemertt 
Gaa (1973) obtained increases in reading hievement as a result of training 
children in setting goals. Steers and Porter (1974), in a review of the 
literatuJ^, stated that there is strong and consistent evidence that the act 
of setting definite goals results in increased pe r f o r n:anc e, Kolh, Winter, 
and Berlew (1968) reported that in two studies pe rs onal -behavior change 
was significantly influenced by goal-setting behavior, 

0* 

Individuals' evahiation of their accomplishments is another important achieve- 
ryfent characte ristic, Katz (1968) proposed a model of achievement in which 
the quality of self- reinforcements determines whether achievement striving 
is sustained. He postulated that in the absence of external reinforcements 
individuals make their own evaluations of good or poor performance. Low 
achievers tend to be those who jHflgc their own performance unfavorably and 
hence terminate-or reduce their striving for achievement, Katz chvscribed 
instances in which habitual low achievers evaluated themselves negatively 
on a school-like task even though their actual attainment levels on the task 
were no different fro^m those of habitually good students who evaluated them- 
selves favorably on the task. Thus Katz perceives the individual's personal 
standard for good performance as contributing in important ways to 
achievement behavior, ' 
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Eiszler and Morrison (1972) provided further evidence in support of the Katz 
position. They demonstrated thjat students who more f/*(^quently reported f^vor- 
able self-evaluations on a school-like task were also more likely to have higher 
grades in school, to have higher levels of expected performance on the task, to 
have g reat(y>^expectations for attaining their persgnal standards of ^ood per- 
formance, and to exhibit greater con^^^fuence between their personal standards 
for good performance and their actual attainment levels. 

Substantial research and clinical experience have demonstrated that several * 
other behaviors and dispositions correlate with successful achievement. To 
begin with, certain perceptions of self characterize achievers, W(» have already 
mentioned belief in internal locus of control. In addition, high achieyers havd 
a clarity of self definition (Mirsch & Costello^, 1967) a nd ^^',e^e r a lly higl^» self- 
esteem (Cooper.smith, 1969; Gill, 1969), They identify wifh po s it i ve - r ole 
models (Kolb, 196b). Their self-ideal relationship is closer than that of low 
achievers (Quimby, 1967). They have self-insight related to achievement 
(Stevens, 1956) and view themselves as competent (Mukherjee b Sinha, 1970), 

High achievers also tend to have certain attitudes. They are interested in 
achievement and talk about it (McClelland, Clcirk, h l^owell, 195 3). They value 
achievement (Murkherjee, 1968), In one sense, they are achievement oriente<J 
(Reitman, I960). They express pride in accomplishment (Atkinson & Reitman, 
195^) and pride and pleasure in success ( Winterbottom, 1958). They value 
work and imagination more than do low achievers (Pierce, 1959). Ihey place 
value on skills (Birney, Burdick, & Teevan, 1969). They believe that hard 
work will pay off (Coleman et al. , 1966). They have a desire for autonomy 
(Veroff, 1969). They display independence and both a r^lity orientation ' 
(Greenberg, Gerves, Chall, & Davidson, 1965) and a future orientation 
(Cottle, 1969). 

Typically high achievers select tasks which have certain characteristics. First, 
they se^k latitude, that is, they seek tasks which give them greater autonomy. 
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(Lilwin ^ -Stringer, 1968; Rosen & D'Andrade, 1959). They respond to 
situations where they believe per sona I' /efforti*' wi U make a difference 
(McClelland, ,1961). '^hey seek situations where they can set their own 
standards (McKeachie, 1968). They are intrigued by tasks which are 
tests o^skill ratb/r than luck (Lefcourt, 1<^6; Locke, 1.96S). 

- i 

Ojicfe having selected a task, achievers display certain task 'attitudes'^nd 
behaviors. They have high expectations of success (Crandall, Katkovsky, 
8rf Preston, 196Z), They express an aspiration level (Kausler, 195^9). 
They focu9 on the positive reinforcements of a task (Crandalh 1968), As 
alreaciy stated, theyVir^e realistic and choose moderate-risk levels of 
behavior, 1 hey exhimt low goal discrepancy (Vitz, 1957). They specify 
goals and view tasks^as a test of skill (Lefcourt, 1966; Locke, 1965), 



Achievers take the iqitiative in searching their environment (McClelland 
h Winter, 1 969)V^They are concerned with formulating concrete action 
for goal attainment (de Charms, Collins, Jackson, Shea*, V^69). They 
often refuse help, even when offered (F'eather, 1966), I'heir time orienta- 
tion is straightforward, concerned with economy, and focused^ on goal- 
directed activities (Heckhausen, r967). Green and Knapp (1 959) indicated^ 
that achievers are economical in their use of time. Ihey are willing 
to postpone gratification (Heckhausen, 1967), They are task-persistent 
(Feather, 1966). They learn to improve the,ir behavior in task situation^ 
wher^e learning can affect performance (Lowell^ 1952). They worl<f hardeV 
following failure than following success (Smith, 1964). Finally, they 
return to complete unfinished tasks (Heckhausen, 1967). 

Quality of s elf- evaluation also significantly characterizes high achievers. 
They feel responsible for both success and failure (Crandall, • 1 965; McGhee 

Crandall, 1968). They have greater critical ability (Greenberg et ah , 
1964). They seek and use feedback (Kolb cL ah , 1 968 ; Moach'um, 1 965), 
-They keep records of progress toward goals ("McClelland . 1 965) and plan 
formal periodic opportunities to evaluate (Duel. 1958; Kipnis ^ Resnick, 



1969). /rhey make constructive use of information about th«?ir failures and 
sue ces se 8 (Birney et al. , 1969). 

Ilypothe se s 

The author hypothesized that (a) a synthesis M these research data and clinical 
reports could provide a profile of the behaviors and attitudes that characterize 
successful achievers. He further hy><^hesized tha^{b)^n effective instructional, 
program teaching children to use these achievement behaviors and to model 
achievement di spositions. c ould be constructed on the basis of such datd.' The 
Aqhievement 'Competence Training (ACT) (Hill, 1975) instructional nriaterials 
.represent an. attempt tof^design and, test such a program. The field evijuation 
report preterits evidence concerning the effectiveness of ACT and supports 
the validity of the hypotheses that achlivement behaviors a.nd dispositions 
be identified and taught. . . ' • 
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Description of AC T 

» <^ontc nt 

ACT is a multimedia learning package for late elementary school children 
v^hich providers instruction in a six-step strategy for goal-setting and 
goal attainment. ACT is also intended to instill the dispositional equalities 
characteristic gf achievers. A belief in internal locus of control and 
higher self-esteem are importa'ht desired outcomes of practicf'ng the 
. achievement strategy^ 

The essense of the instructional materials is reflected in the title words. 
'Achievement means the attainment of goals drawn from the full range of 

7 

a child's hopes, plans, and desires^ Competence assumes that a child can 
become more skillful in setting and achieving his goals by learning to * 
utilize the curricuKim strategy^ T rainifig indicates that the child learns 
these skills by applying them it? a wide variety ai experiences, culminating in 
an ability to apply them to his own immediate life interests. 

The six steps of the strategy are (Hill. 1975): Study Self : ability to 
state and cite supjiorting data for personal past achievements and strengths; 
Gci Goal Ideas: ability to generate goal i^eas which are related (o personal 
data; Set a Goal: ability t^ forrWulate and to commit one/self to^goals which 
are desirable, medium risk, aidd specific'in kind, time, and number; IHan:. 

» ' ■ ' • ; 

ability to name and order tasks, seek information, and replan; Strive : ability 
. to envision success; persist in action; and employ affective techniques such as 

.recalling pa st achle v(^ment , remembering heroes, and considering c4)mpetition 
(e.g^, with another, with past perfarmance, with some standard of excellence); 
I^valuabe: ability to determine whetlier goals have been attained, identify what 

was done well and what needs improvement, and identify growth in use of 

achievement skills. 
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F'ormat 

ACT consists of 24 lessons, each divided into tlirt^e parts which last 
15 to 25 minutes each. The teacher may use each segment separately at 
different times or on different days or combine the tliroe segments in ono 
time period. The full package is designed to be used for 2-l/Z hours per 
week for one-half of a school year. Each lesson is administered by an 
audio cassette tape wFiich gives instructions in conjunction witli printed 
student journals. Additional ^aterials and activities (e. g, . games) are 
also included. Teaclier orientation is desirable but not necessary. A 
2-1/2 hour workshop package is available. 

Field- lest Description^ 



Preliminary pilot field-testing ^f ACT took place during I 971 -72, the findings 
from which were used to modify and refine the program. 

Objectives ^ • 

The project entei;ed the final stage of formative evaluation in 1 973, w-itli 
the following objectives: 

1. To assess the functioning and u sability of ACT over a 
delimited range of types of students and teachers; 

2. To determine the effectiveness of ACT in teaching com- 
petence in the use of the achievement strategy and ita 

♦ 

component skills over a delihiited range of types of 
students; ' * 

3. To obtain comparative c|at& on the usability and effoc- 
tiveness of ACT and a/ffcubl'ished set of instructional 
materials (Curriculii^ X) dealing with similar concept^; 

4. To obtain subjective evaluations by teachers and'students 



of ACT; 

To use the info r rt^ation obtained in the field 
revise ACT pri^r to publication. 



test to } 



\ 

The coniparison program. Cu r r i culu m ,X . was selected from published 
curriculut"n materials dealing with parallel affective constructs and 
appropriate for use with fifth- and sixth-grade children. Other criteria 

for selection were that the coriiipa rison program be reasonably priced and 

% 

that it be educationally woiithwhlle in its O'^n right. 



— 

'students from three fifth-grade classes in each of 33 scliqols in the 
Philadelphia metropolitan area pa rtic ip(ated in the field test (11-99). In 
each school bn^ fi ft h- g ra d e class received AC'^^^ second class received 
Curriculum X (comparison package); and a third class received no special 
program and is referred to as (un-instructed) Control.' ^Classes within each 
school were randomly aSssigned to the three groups* 

Sc'hools were classified ihto three average fam ily- incom e levels ( liable I). 
These descriptive income classifications were not part of the analysis of. 
variance design and were used only as a basis Tor correlating estimated 



faniity-dncome level with mastery of ACT content. 



Insert Table I about here 

A further characteristic was that Ss were drawn only from\hose schools 

I — . ' f'' 

where the fifth-grade class average reading level was at or above.the 3, 5 
grajde ievel. ^ . 

Method 

Special Conditions of the Field Test " ' • ^ 

The field test was planned largely as a ^'hands-off test, although under 
optimal conditions. Therefore, certain guidelines for use of the package 
were specified, and the use of the package in each classroom was monitored 



in 
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periodicallv; hy field niana^ers. Both the AC/V anc] Curriculuni X pro^ranis 
are acconipanied by teac her's manuals to cna|}le the t ea ( her to conduc t 
them without formal training. However, to achieve optimal testing con- 
ditions, orientatiojv and training sessions were con^lucted with teachers in 
both programs. All teachers were also asked to fill oijt a reaction form 
after each lessOn, and ACl teachers were furtlier asked lo tabulate, 
student responses to selecteditemsonlesson tests. 

Time guidelines for the use of ACT and Curriculum X were suggested. 
I'f^achcrs were asked to devote approximately Z to Z-l/Z -c lass hours pc^r 
week to program activities. ACT took an average total tinu; of 3Z (Tass 
hours to administer. Total dura:. on of the field test varied between 5 and 
7 months, with Curriculum X gene-ally being completed in 4 to 5 months. 

f . P 

Mi'asures 

, ^ {• 

During the field test, data were collected to assess both the usability and 
the c-f fecti vcncss or impact of ACT (Table l/. Thib * - o r t f <jc u s c s [primarily oi 
the data pertaining to effectiveness of ACT, with sojiie dis' 'ssion of pro- 
cedures and outcomes in the assessment of usability, i he data on usaljility^ 
were collected from field mana^^ers' reports, reaction forms. ii\lerviews. 
anecdotal reports, and teacher observation. Assesstiient of the effective- 
ness of ACT was concerned both with testing for student mastery of 
vocabulary, concept/, and skills as taught in ACT and with tijsting for 
enhanced co rripet enc e^j a nd attitudes related to achievement. Mastery of 
program content was measured by tests included within AC T and-^by a 
criterion- referenced erui- of- prog ram Mastery T(^st in whic h s(ud(Mits were 
asked to recall and apply material from the course, ilowc^ver, 
most of the testing efforts were devoted to looT<ing for effects of fho prc^gram 
upon students* actiqns or feelings, which could only be evaluated by coynparing 
students who had and had not been in the ACT program. Other n^easures. 



Insert I'able Z abx)ut here 
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not aimed at particular ac hi ove niont stops, wor(; intendcul to at 
generalizoci Hi s pos i t i oti s or attitudes: s c I f- c va I'ua t ion of pcM'sonal Action 
Inventory and Children's Lo^c^s of CoiHrol Scale, 



Two measures were used as sources of in fo r riiat ion which nii^ht cxphiin 
differences amon^ children in the cfft^ytivencs s of tlu^ pro^rani: Tht* 
California Test of Mental Maturity (CIMM) and the Test Anxiety Scale 
fo r Ch ild r en. 

Several kinds of clinical data were also collected, inc luding random structured 
interviews with children and teacliers; anecdotal reports by teachers, chil- 
dren, parents, and school administrators; and teacher' lesson reports atul 
observations of classroom activities. These ^<lata provided a qualitative 
description of the useand effects of the materials (Beckingham, Davis, 
Kekaios, Schmuckler, 1974). 



Testir^g Prbc edu res 

'lable 3 shows the schedule for administering the measure's of ACT effec- 
tiveness. T+\e^ items in the ACT journals, the lesson tests, and the AC T 
Mastery Test we r e a d m i ni s t e r ed only to the ACT classes. Vhr, reniainin^ 
tests were administered to the stufients in AC T, Curriculum X, and the 
Contiol classes. Data on the California Test of Mental Maturity were 
available from Z5 schools. All other j^ests were administered m alt* 33 
schools. 



Ins(^rt [ able 3 about hert? 



Statistical Analysis of Data 

The analysis design for the assessment of program effectiveness was a 
two-factor design with Treatment as a th ree- level tacto r (ACT, Curriculum 
X. and Control) aod .Schools as a blocking factor, with 33 levels in most 
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instances. Hypotheses pertaining to Treatment effects were tested by 
means of two planned comparisons. In the first comparison ACT and 
Curriculum X were averaged and contrasted with the Control group in 
order to' detect an effect attributable (o being in one of the Expe r i,m ental 
programs. In the second comparison ACT was contrasted with the 
Curmculum X classes in ord^er to detect advantages to being in one 
Experimental program as opposed to the o.ther Experimental program. Thus 
the two planned comparisons taken together provided tests of the two sources 
of effects of greatest interest in the. Treatment factor: effects attributable 
'to the Experimental program in general and effects attributable specifically 
to ACT. An alpha level of . 05 w^s used in performing the planned com- 
parisons.'- In addition to the planned comparisons, Dunnett's Test was 
performed contrasting the Control group separately with each of the Experi- 
mental groups. Because Dunnett's Test was performed as a post hoc 
analysis over and above the planned comparisons, a .01 alpha level was 
used in order to^ minimize the overall error rate per hypothesis. The 
•class mean was used throughout as the unit of analysis. " This moan was 
estimated using a sample of 14 students from each classrootn. 



Results 

Pr cprograti-i Con-iparison Among Groups 

Means for the-four pretests and the IQ test are shown in Table 4. Univariate 
analysis of vai^ianc5fe performed on these five measures revealed no signi- . 
fica^^tLP^ nea r- significant differences between the three groups prior to tjie 
field test. 



Insert Table 4 about here 



Studenj Mastery of Content in the ACT Instructional Materials 

0 > 

Results pertinent to student mastery of the vocabulary, concepts, and skills 
taught in ACT consist of performance 6n items in the ACT journals and 
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lesson tests and performance on tlig. ACT Mastery Test. Data, on student 
performai^e on items in the journals and lesson tests were originally 
collected for 10 students from each of the 33 ACT 'classes. .However, since 
it was^discovered that some teachers were not adhering to the prescribed 
scoring criteria, a decision was made to sacrifice questionable data and 
use only accurate data from fewer schools. Toward the end of the school 
year the field managers collected journals and lesson tests from 10 ACT 
classes and retabulated student perform^ince; however, due to lost or 
misplaced papers many of the tabulations were based on fewer thar^ the 
specified lO students per class. < 



Figure,s 1 and 2 portray student performance on selected items from the ACT 
journals and lesson tests. ^ . 



Insert Figures 1 and 2 about here 

Performance on the ACT Mastery Test (Table 5) is related to the six ACT 
achievement steps. 



Insert Table 5 about here 



Summer Camp Test, Locus of C5ntrol Scale, and Self- Evaluatiori 

Uni var iate* analy s es of variance on the posttest versions of the Summer Camp 
Test (which assesses ability to apply concepts of self- direction as taught in 
ACT) and the Locus of Control and Self- evaluation mt^asures revealed that 
ACT scores were significantly higher than Curriculum X scores for all ih'^ee 
measures. On the other hand, the combination of ACT and Curriculum X 
differed significantly from the Control group only on the Locus of Control 
measure. However. Dunnett's Test contrasting the Control group separately 
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with the two Experimental groups revealed that ACJ was significantly 

higher than the ''Control mean on both the Locus of Control and Summer Camp 

measures (Table 6). 



Insert Table 6 about here 

: 1 



Connect the Numbers Game ^ 

The Connect the Numbers Game is a situational test in which the student is 
provided with feedback on his performance on a task over several trials 
and given an opportunity to estabTish his" own level of predicted performance 
and ms own standard for doing a good job. The following variables were 
analysed for the Connect the Numbers Game: Number Correct; Attainment 
Discrepancy (student's actual attainment minus his predicted attainment); 
Standard Discrepancy (student' s per sonc^l standard for good performance 
minus his prediction); Risk (student's attainment prediction minus actual 
attainment on a previous trial).; 



\ - 
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Insert Table 7 about here 



Means for variables in the Connect the Numbers Game are shown in Table 7. 
No Treatment differences were found for Nun^ber Correct or for Attainment 

♦ 

Discrepancy. In the statistical analyses large'and significant differences 
between Treatments were found on Standard Discrepancy. Both planned 
comparisons were statistically significant, with the^mean for ACT lower than 
the mean for Curriculum X, and the combined mean for ACT and Curriculum 
X lower than the Control mean. The ACT mean was also significantly lower 
than the Control mean. These results show that ACT students had a smaller 
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discrepancy than oilier groups bctwe^ their personal standa^rds for good ^ 
performance and their predicted performance. 

The term "Risk" refers to the degree to wliich students established an 
expected level of performance for their /lext attempt that exceeded their 
prior per for^tt^nce. Theory and research in achievement beliavior portray 
tlie high aeh^^^r as one who on each successive repe^tition of a task attcrT^pts 
to pfrforqi at a slightly higher level of proficiency, so-called mcdium- 
risk-taking. Conversely, the lower achiever, in whom the fear of failure 
is'i^tronger than the motive' to succeed, tends to set either extremely hi^h 
or extremely low goals in relation to prior performance. Both high-risk- 
taking afid low- r i sk- ta ki ng are regarded as defensive strategies for avoiding 
responsibility for failure. 

In comparing the risk-taking strategics of different groups it is common to 
compare the varia>\ces of risk scores instead of, or 'in addition to, the 
J^erage risk scores (e.g.. Stake, 1973), The risk levels expect ed o f hi gh 
achievers are in the moderate range between the high- and low- risk levels 
expected of low achievers. The average of the high- and low-risk scores of 
low achievers may eqi^al the average of'the mediuoi-risk scores earned by 
liigh achievers. Thus while there may be no difference in the average values 
of risk scores for high- and low-achieving groups, one would expect t^o find 
a narrower range of risk scores in the high-achieving groups. 

In the analysis of the Risk variable (Table 8) the expected differences among 
Treatments in the distribution of Risk scores were not observed. On the 
dther hand, differences were found between Treatments in the mean values 
of Risk scores. The combined mean for ACT and Curriculum X students 
was found to be signi ntly higher than the Control mean. The contrast 
between ACT and Control approached but did not reach significance. 



Insert Table 8 aboi^t here 
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Contrary to expectations, the effect of the achievement-training programs ^ 
on, risk behavior was to raise the level of risks taken by students, in particular 
to produce a shift toward the higher end of the medium-risk range. -Since 
all ihree groups seemed to be composed of predominately medium- risk- 
takers, the^,effect of training seems to have been to slightly elevate, Risk 
scores without promoting the strategy of setting unre*ali<stic goals* * 

4 ■ 

0 

Sg'rarTiblcd Words Game 

' — ~~ • 

The» Scrambled Words Game is identical in format to Connect the Numbers 

Game, although the task was to solve anagrams. The four ylriables for 

the Connect the Numbers Game were analyzed, plus the following three 

variables: 

1. Prediction- -the number which the student says he expects ' 
to get correct 

2. Standard--the number which^the student says he would have 
to at^t^^ to feel that he had'done et good job^ 

3. Standard-attainment Discrepancy--the discrepancy between 
the student's personal standard and his actual attainment 

Statistical analysis of the means for the seven variables (Table 9) and 

variances for the Risk variable (Table 10) detected no Treatment effects for 

« 

Number Correct. The ACT group had a significantly l9wer (i* e. . more 
negative) score than did the Curriculum X g roup to r Attainment Discrepancy. 
However, the ACT group did not differ significantly m the Control group 
•on Attainment Discrepancy. On the Risk variable ACT classes had a 
higher mean than did Curriculum X classes, but there were no di ffer enc os 
between ACT and Control. 



^. 

Insert Tables 9 and 10 about here 



All the relevant contrasts were significant for Standard Discrepancy. ACT 
students had a smaller discrepancy than did either Curriculum X or Control 
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students between their personal standards for good perlorriianc o and their 
predicted perfprmance. 

For the Prediction variable ACT students had a significantly higher mean 
than did Curriculum X students, although their mean did not differ iro\^ that 
of Control students. On the Standard variable the combined mean lor ACT' 
and Curri^:ulum X students was significantly lower than the m(»aii for Control 
students, indicating a trend for students in th e. Expe r i m enta 1 programs to 
establish their personal standards for doing a good job at a somewhat lower 
4eveL The contrast between ACT and the Control group came extremely 
close to l)ut did not quite reach statistical significanc:e. A similar pattern 
of erffects was found for Sta nda rd - atta inment Discrepancy. That is, the 
combined mean for ACT and Curriculum X was significantly lower than the 
Control mean. Yhe difference between ACT and Control approached but 
did not reach significance- These effects de sir ibe a trend for students in 
the Experimental program.s to establish a personal standal'rd for gooV— ^ 
performance closer to what they wfere actually able to attain as comparer) 
with their Cafttrol peers. 

Teacher In'te^rviews \ 

' ■ 1 * 

A limited number of teachers /nd children were randomly chosen to 
participate in structured interviews follo„wing the field test; Eleven t^iachers 
were asked to respond to selected questipns (Table 11) and to rate responses 
on a positive-negative continuum, ^^^^^^ ' 



Insert Table 1 1 about here 



ERLC 



Student Interviews ^ 
Individual student interviews were conducted in nine ACT classes with four 
students per class (Table 12). The interviewer assessed the attitude ox- 
pressed in the student's response and rated responses on a p ositive - negative 
c onti nuum. 
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Insert Table 12 about here 
. -^-^ 

Obsc rvat ions 

Evaluation staff memb^ers made periodic visits to ACT and Curriculum X 
classrooms.^ Observers made records ^f whether the materials were being 
used, how they were being used, and student reactions and activities 
(Beckingham et al. , 1974). All but two of the ACT teachers completed the 
full coase of materials. Thirty two of the 33 classes carried out a class 
proje'ct using ACT strategy and materials. These activities were extremely 
varied and reflected the children's energetic use of the brainstorming tech- 
nique taught^in the second strategy step. The following two examples suggest 
the range of activities. 

1. T+ie goal of this class was to have a kids -as-teachers day 
for grades 1-4. The children gain-ed insight into some of 
the problems teachers face and were amazed at the amount 
of planning and stamina necessary to teach an interesting 
lesson.' The teacher said, "Some were amazed that 
lessons they had planned for hours took only minutes to 
teach^ Some children were able to verbalize about their * 
increased understanding of and appreciation for all the 
work teachers .must do. Several made comments about 
wanting to be teachers." 
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2. I'he class goal was to "have a charity, bazaar with^ainos, 
chances/ white elephants, refreshments, exlubits, and 
handicrafts." The bazaar was successful, and the 
children raised $97. 95,- which they gave to a nearby 
school for cerebral-palsied children. As a result of this 
initial contact, some class members began to work with 
the cerebral-palsved chidren on a semir^gular basis. . 

/ 

Anccd ote s ' ^ 

ACT teachers and one principal member of the ACT evaluation staff 

collected over 150 anecdotes concerning use of and reaction to the ACT 

# 

materials. These anecdotes include reports from child r en, teachers, 
parents, and administrators (Beckin^ham et al. , 1974). Two typical anec 
dotes are reported below: 

1. The teacher reported that Debbie told her that she had 

been pleasantly surprised with the results of the Strength 
Survey, not having realized how many strengths she had. - 
Debbie also said that learning about risk had made her 
realize that some Qf her work for a social studies project 
was really too easy. In one instance, she had redone a 
report to meet her higher standard. 



2. The teacher reported that, one of his reading groups'was 
to put on a play for the class. Some members of the 
group were in the ACT class. At first iiic children> 
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bickered and argued about how to produce the play; finally 
k a boy who had been art ACT group leader sugg ested that 
they choose a group leader to get things written down. 
TheT others agreed, and the group began to plan con- 
structively. It was obvious, the teahcer said, that the 
initiative was taken by the ACT children. 

r 

Teacher Lesson Reports \ * * 

Teacher lesson reports turned in to the evaluation staff by Curriculum X 
and ACT teachers focused almost entirely on the operational aspects 
of the lesson and the reactions of the children to specific aspect's of lessons 
(Hill &.Campiglia, 1974). The information was valuable during revision 
of the materia^l^ 



Discuss i on 



Student Mastery of Content ^ 

In their ACT lessons and lesson tests, students showed mar_ked improve- 
ment in their ability to list personal past achievements, strengths, goal ideas, 
and tasks related to a goal. It may be argued that these demon striated 
changes" reflected practice effects more than real increases in self- 
knowledge and goal-setting skills, that students may. have had different 
levels of motivation, and that they may have understood the task differently 
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on posttesls as compared with pretosts. Nevertheless, the lesson-tests 
resuL^ showed that* students made tl>e desi red- responses after relevant 



instruction. 



Performance on the ACT Klkstery Test waTs somewhat 'les s impressive, 
although the pattern of resuAs seemed to reflect the instructional emphases 
of the package. During the figid test 7 8, 4% of the students earned at 
least 80% of the points on the ACT Mastery Te^t relating to the achieve- 
ment step Set a Goal. All but one of the possible eight points in this area 
pertained to specific goal statements- -a crucial aspect of goal-setting in 
the prog'ram. Performance was very good for items relating to the Study 
Self step, satisfactory for tlie Plan step, and poor for the Evaluate and 
Strive steps. * 

One explanation for these uneven results may be that the Mastery Tost was 
administered in many classes before students had conipleted the review 
unit. Thus, students may have performed most poorly on the Strive and 
Evaluate achievement steps because in most cases tliese were not reviewed 
until after the Mastery Test was given, A second explanation may be that 
instruction was les-s effective for the Strive and Evaluate steps. Post hoc 
examination suggests that conceptual confusion may also have been a 
contributing factor to poor results. These lessons have been rewritten 
for the first commercial editiop. 

Su mmary of Affective and Performance Indicators 

Statistically significant differences favorlngACT students over Curriculum X 
and Control students cannot be attributed to change variations beUween the 

V 

groups; they are clearly attributable to students' participation in ACT. ACT 
""students demons4:rated the following attitudes or behaviors to a greater 
degree than did their agemates; 

1, greater belief in internal locus of control ^ 
Z.r greater' tendency to prescribe self-directed solutions 
to problems 
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3. less disfcrepancy between sejf-predicted pe r fosi^^ianc e 
and self-set standard of good performance 

4. lower personal standards for good performance, i.e... 
more realistic standard for success 

5. a standard toward slightly higher levels of risk in 
goal-setting 

These assertions must be further elaborated to be made consistent with 
the total findings. In considering all statistically s igni fi ca nt f f oc ts 
(Table 13). it is puzzling that on some measures the ACT group differed 
significantly from the Curriculum X group but not from the Control group. 
Since the Curriculum X group was included in the evaluation design as a 
safeguard against incorrectly attributing posttest differcvnces to the specific 
instruction ind experiences provided through ACT. i4 was arnticipated 
that fewer differences would be detected between ACT and Curriculum X 
tiian between ACT and the Control group, with the former contrasts 
being critical for recomaiending ACT over the a Ite r na t i vc p rog ram . One 
possible explanation is that certain features intrinsic: to Curriculum X 
produced effects contrary to the desired effects. A second possibility is 
thatan awareness in the Curriculum X teache r s - - a nd perhaps students-- 



Insert Table 13 about here 



of being assigned 4o the les s - pr e f e r r ed program may have interfered with 
potential benefits of that program as compared with Control classrooms. 
Whatever the explanation. Curriculum X failed in large measure to produce 
the anticipated effects. Therefore it seems that the greatest c^onfid(Mice 
about outcomes should be reserved to those measures on which ACT differed 
significantly^ from both Curriculum X and the Control group. 
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Self- Pi rcction and Locus of Control 

On both the Summer Camp Test (cognition) and the Children's Locus of 
Control Scale (belief system) i\\e ^CT group exceeded tlie oilier two groups 
to a greater degree than could occur by chance. The trend was for ACT 
students to be more internally controlled and s elf- di r ec ted in, presc ri bi ng 
solutions problems (figures 3 and 4). 

^ 

Insert Figures 3 and 4 about here 



Self- Evaluation ^ 

On the Self-evaluation measure ACT students significantly exceeded ^ 
Curriculum X but did not significantly exceed the Control group. Thus 
the most conservative conclusion would be th*at ACT did not significantly 
alter students' self-evaluations. However, a choice between the two 
Experimental programs in terms of promoting positive self- evaluations 
would clearly favor ACT over Curriculum X based on those data (F'igure 5). 

/ 

Insert P'lgure 5 about here 
Expectations for Success and Attainment of Personal 

Standards for Success ^ 

^The results from the Connect the Num.bers/ and Scrambled ,Words Games 
were interesting both because of the disguised purposes of the instruments 
and because of the r elal i onsli i p o\ the measures to publislied r^^'Search in 
achievement behaviar. '^'mdard Discrepancy showed significant fMfects on 
all contrasts performed (or both games. For ACT stuc^^nts the difference 
between their personal standards for a good job and wliat they ac tually 
expected to attain was less, than for either Curriculum X or Control students. 
One could say that ACT students had greater expectations for doing well or, 
stated another way. had more realistic standards for success. 
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Results of [he Seratiibled Words Ciatne showed a trcnrl for ACT sttidcMUs 
also to have smallep'- disc repancies between tlieir perscMial statuJards arid 
their actual a 1 1 a i tii ent s . This effect was statistically significant for ACT 
4" Curriculutii X versus the Control group and approached s i ^ ni I ua nc 
for ACT versus the Control group. Analysis'af Standard showed parallel 
effects. rhe pattern cnierging froni the data showed tiiat ACT students 
lowered their personal standards for good perlorniance to l)e more 
consistent with what they expected and we r<i able to attain. 

These findings concern one of the most important eflec ts of tlie AC'V program, 
particularly with regard to the process of changes in goaUsetling bcliavior. 
As previously stated, Katz (19<')H) developed a model of ac lii e vcmcMit 
motivation based on the premise that ach i e ve m ent - s t r i vi ng_k^ sustained by the 
quality of covert s**e If - r e i n fo r c em ent s . It follows that training in acliieve- 
ment behavior would hinge on making these covert r e i n fo rc em cmi t s more 
favorable. By causing the student to lower his subjerMivc^ standard of 
success in order to reduce the discrepancy between 1 li i s standard and li i s 
i^xpected or actual performance, one can increase tiie student's subjective 
experience of success. As a test of the Katz model, using a task similar 
to our Scrambled Words Game, Eiszler and Morrison lound tliat 

ninth-gracJe black students who evaluated thems<dves favorably on the 
task also had greater expectations for doing well. 

Estimating Pe r fo r riianc e and Risk- Taking 

There was 6ome tendency for ACT students to overestimate their perfor- 
mance more than did the other groups, as indexed by liiglier Attainment 
Discrepancy scores. This effect may he interpreted as an increase in 
motivation to perform well on the task. 

In comparisons between variances on Risk. ACT students did not show the 
expected trend toward more m ed i u m - r i sk - 1 ak i ng . i'rom inspection of 
the data it seems most reasonable to conclude that the childreri in all 
three Treatments shared the cultural norm of m edium - r i sk - tak i ng . 'The 
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only effect of ACT seems to have bam to shift Risk stores toward the high 



end of the range of rncdiutn- risk scores. 



Int e rco r r c lat ion s Aniong Moasurcs 



None of the i nte rc o r r e la t ion s a niong the evaluation tests for ACT students 
shown in Table 14 exceeded a niodorate level, indicating that the various 
tests were measuring differer^t constructs. Most surprising was the 
absence of any substantial oorrelati'on between IQ and any of the response 
measures. H is interesting that there was a moderate correlation of . Si 
between the Summer Camp posttes4, and the ACT Mastery Test, suggesting 
that those students who were more successful in mastering program con- 
tent were also more successful in applying program concepts in a disguised 
context. 

Although not shown in Table 14. ihe correlation for ACT students between 
9* fa mi ly- income classification and performance on the Summer Camp T(vst 
was .58. This is not to suggest that the concepts and skills taught in ACT 
could not be effectively taught to students t)f lower-middle and lower 
economic classes. Researchers have found that in middle-class homes 




reinforce ACT instructions; such supporting variables are not present in 
lower-class homes. There/ore the impact of ACT might actually be 
greater among children who receive less training and modeling of achievement 



such as parent at ti t ude s . tha t would 



behaviors and attitudes at home. 



Insert Table 14 about here 



Interviews^ Reports^ and Anecdotes 



Teacher and student interviews, anecdotes, and teacher reports provided 



a qualitative picture of the effectiveness of ACT. Admittedly, all such 



data tend to be positively biased. This is particularly true of anecdotes. 
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Nonetheless, the interviews have a convincing quality because of their 
cone rete* detailed descriptions, and all anecdotal rep<^fs are specific 
in their descriptions of behavior. 

While many of the teacher and student interviews focused on specific con- 
tent and format issues important primarily for revamping the materials.^ 
several questions^alled for evaluation of the^overall effects of the program. 
Teachers were strongly positive in their belief that the children learned 
some beneficial behavior and attitudes from ACT, citing, specific examples. 
They also reported i^i^rthey would use ACT skills and strategy in tlie future. 

Interviews with the children were also highly positive* Children reported 
that that they had learned something worthwhile, th^t they learned something 
new about themselves, that they used the ACT strategy outside of school, 
that ACT helped them achieve goals they would not otherwise have achieved, 
and that they would recommend that their friends use the^materials. 

The approximately 150 acecdotes supported the direction of the interviews. 
The notes of the staff and teachers provided a wide range of instanc€^^ 
which children, ^th singly and in groups, used ACt skills and content in 
transfer situations. These anecdotes were both self-reports of students 
and observations of students by other students, parents, and teachers. ^ 
Students were portrayed as using the whole strategy or parts of it as they 
set goals -and working to achieve them both in school and in other areas of 
their life. 

The teacher reports provided specific descriptions of the operation ACT, 
testifying to the effectiveness of the program while at the same time identify- 
ing program areas needing revision and new tryouts. 
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Taken together, the interviews, anecdotes, and teacher reports pro^^^ded 
evidence that the children generally enjoyed using the materials, thai tlie 
materials were effective in teaching the skills and content, and that chilcjren 
were disposed to use these skills and the content in their own lives. 

' Sumn>aVy of Findings 

In summarizing th^^ evaluation findings, a number of signigicant effects of 
ACT emerge: 

1. ACT children learned and used specific skills and content 
prescribed by the lessons, as indicated by student re-' 
sponses in their journals, lesson tests, observers' 
reports, teacher reports, and student group projects. 

2. ACT children retained much of thi^ learning after comple- 
ting the instructional materials, as indicated by their 
Mastery Test scores. 

3. ACT children were disposed to use the ACT skills and 
content, as evidenced by the Summer, Qamp Test, the 
Scrambled Words Game, and the Connect the Numbers 
Game. 

^ 4. Attitudes of the ACT children changed in a positive dir- ' 

,ection, as indicated by the Locus of Control Scale 

scores, student interviews, and teacher interviews. 

. ^ 5. ACT children used the skills and content outside of 

ACT classes and in some cases outside of school, as 

indicated by teacher interviews, student interviews, and 
i 

anecdotes . 

r 

Considered singly, each effect and its supporting data might be considered 
only partically persuasive. However, when the findings are assessed 
cumulatively, they present convincing evidence that ACT had a significant 
effect upon achievement dispositions and behaviors. 
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Conclusions 
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Educational Significanc Q^of Results 

Unlike the objective significance of statistical results, the educational 

importance of demonstrated effects is ultimately a matter for personal' 

A. 

judgment, f^tatis tics^l significance or nonchance differences between treat- 
ments is necessary but not sufficient for proving the educational value of 
a program. The prospective user of ACT should consider the relevance of 
the measur^^on which statistical effects w.ere found, as well as the gains 
made by the ACT group in comparison with the other two groups. 

The difference in the Locus of Control Scale is difficult to interpret. Is a 
difference between the ACT group and the Control group of slightly less 
than 1 point educationally and practically significant? Given the large 
number of the sample, it could be maintained that it is neither. However, 
ohe must consider the insensitivity of attitude self-report measures in 
general, this particular measure's reliability, the^fact that scores are 
already skewed toward the higher levels, and the fact that this is a 
measure of group means. 

Any conclusion seems open to challenge. Independent scholars who 
reviewed the findings maintained that at worst the results were inconclusive 
and at best the measure should be considered in the context of the other 
data. Given these criteria, tKe results can reasonably be considered 
educationally and -practically significant. 

V 

Richard Teevan, Ph. D. , Chairman of the Psychology Department of 
SUNY, Albany, an independent ACT reviewer, made the following statement 
concerning the evaluation data: "There is no statistical way to determine 
whether or not a given difference's practically significant. In order tp get 
an answer to this crucial question, I went over all of the comments of the 
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teachers, the comments of the students, and the comnients of the observers. 
1 especially looked for comments which suggested that the children were 
more self- initiating , felt better about themselves, were able to work better, 
etc. In view of these comments and the statistical findings, it is my 
opiniofl that the results are practically as well as statistically significant." 

Considerable educational significance, particularly in terms of behavioral 
effects, may be attached to the magnitude of effects for Standard Discrepancy 
in the Connect the Numbers and the Scrambled Words Games. To the 
extent that, these tasks reflect the goal-setting behavior of students, the 
results wore impressive. It is probable that ACT students were more 
frequently able to experience subjective feelings of success bex:ause their 
self-set standards of success were closer to their predicted performance. 
This realism in turn pi*ovided a basis for more successful goal attainment 
in the future. ' 

Given the finings that ACT had demonstrated effectiveness in teaching 
children to use selected achievement behaviors and to model certain i 
achievement dispositions, it can be concluded that hypotheses (a) and (b^) 
were supported, i. e. , these behaviors can be identified and taught. It 
should also be restated that these behavior s. and dispositions correlate 
with a wide variety of positive outcomes in the academic, personal, and 
social domains. . ^ * 

The ACT materials represent one example of what might be accomplished in 
training for achievement skills. For these reasons it s^ems to behoove educ, 
tional authorities to consider the possibility of including specific instruction 
for achievement behaviors and dispositions in the school cutriculum. 
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Addendum 

l^lthough the. field test was conducted in the manner of a summative evalua- 
tion, the field-test vefsion of the ACT package was not the final one. In 
response to the data presented in this report and in the statements of 
teachers and students, over 50% of the script lines have been revised. 
Those area^s, such as the Strive and Evaluate steps, that gave poor results 
on the Mastery Test have been altered to assure instructional tlioroughnes s 
and conceptual clarity. Although these changes have improved the overall 
quality of instruction, , none of (he basic concepts of ACT has been changed. 
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TABLE I 

distrifu;tion by average family income 
of schools used as test sites 





^^'verago Family Incomo for School Area 




$10, 200-$12, 900^ 


$13, 000-$14, 900 


$15, 000-$Z9, SOO 


Number of 
Schools 


14 


7 

», ■ 


u 
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TABLE 2 

MEL^SURES USED IN THE ASSESSMEN T 
OF ACT EFFECTIVENESS 



M ea tsu re 


Desc ription 


Origin 


ACT JournaiiB and Lesson 
Tests 


Criteripn- referenced items appear- 
ing throughout the ACT package 
which are d assigned to assess stu- 
dent learning of ACT concepts 


w 

Project - developed 


ACT Mastery Test 


A c ri I e r ion - ro f e r enc ed lest 
administered to ACT students at 
the end of the program to assess 
their retention of ACT vocabulary 
an^ concepts 


P reject - developed 


Self - e va Uiat i on 

of Personal Action 


An inventory which yit^lds an index 
for favorable evaluations of one's 
own acticfns. The test has an 
internal consistcn cy reliability 
of . 77 ^ 1 ■ ■ 


P reject- developed 


Children's Lo c u s 
of Control Scale 


An inventory on which the child 
reports his perceptions regard- ^ 
ing the locu4 of control over his 
life experiences. The test has 
a test-retest reliability of * 73 


Bialer. 1961 


Test Anxiety Scale 
for Children 


An inventory on which the child 
reports anxiety pertaining lo 
school and tests 


Sa r a s o n , Da v i s o n . 
Lighthall. Waite. &i 
Ruebush. 1961 


Summer Camp Test 


m\ilt i pi e- choice test which 
assesses the child's ability to 
apply ACT concepts of self- 
direction. The test has an 
internal consistency reliability 
of . 76 


Project - developed 


California Test of 
Mental Maturity (CTMM) 
(short form) 


An IQ te9t ^^T:::^ 


CTB/McGraw-liill ^ 

/ 



ERIC 
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TABLE 2 (Continued) 



MEASURES USED IN THE ASSESSMENT 
^^^^Qj::-ACT EFFECTIVENESS 



Measure 



Connect the Numbers 



Scrambled Words Game 



Desc ription 



A situational test designed to mea- 
sure the student's ability to 
accurately estimate his perfor- 
mance on a task and to set a lev(?l 
of predicted performance 
commensurate with his prior per- 
formance on the task and his 
personal standard for good 
performance 

A situational test similar in format 
and purpose to, but differing in 
content from, the Connect the 
Numbers Game 



Origin 



Project -developed 



P r oje ct - dev eloped 



ERIC 
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^ TAIU.E 3 



SCHEDULE FOR ADMINISTERING MEASURES 
OF ACT EFFECTIVENESS 



f 

Moa sure 


When administered 


• 

Administorod by 






Pretest 


Inte r nal 


Posttest 


H BS 


T e at h c r 


- 






test 




tester 




A T Tf^iirnalfi and IjPSSOh 








X 




X 


Tests 














ACT Mastery Tests 








X 




X 


Self-evaluation 




X 




X 


X 




Locus of Control 




X ' 




X 


X 




Test Anxiety 


0 


X 


\ 




X 




Summer Camp Test 




X 




X 


X 




Calif. Test of Mental 




X 






X 




Maturity (CTMM) 














Connect the Numbers Game 








X 


• X 




Scrambled Words Game 








X 

1 


X 
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TABLE 4 

MEANS FOR IQ AND PRETEST MEASURES 



Measure 


Treatment 


* 


ACT • 


H 


Curriculum X 


R 


Cont rol 




IQ (CTMM) ^ 


109. 33 


25 


108. 77 


25 


109. 05 


25 


Self-evaluation 


15. 44 


33 


15.45 


33 


15. 42 


33 


Locus of Control 


14. 4 1 


33 


14. 47 


33 


14. 37 


33 


S umme^r Camp Test 


10. 50 


33 


10. 56 


33 


10. 37 


33 


Test Anxi^^ Scale 


10. 74 


33 


10. 05 


33 


10. 28 


33 
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■ TABLE 5 

AVERAGE NUMBER OF POINTS ON ACT MASTERY TEST AND 
PERCENTAGE OF STUDENTS WHO RECEIVED 
80% OR MORE POINTS SUMMARIZED BY ACT STEP 



, ACT step 


Ave rage 
of points 


number 


Percentage of st\i dents 
who received 80% or 
more points (criterion) 


Naming of Steps 
(Max. = 4) 




2. 39 




4 5. 77o 


Study Self 
(Max. ^ 4) 




3. 29 




80. 77o 


Get Gpal Ideas 
(Max. = 6) 




4. 50 




55.4% 


Set a Goal 
(Max. = 8) 

Plan 

(Max. = 4) 




6. 83 
2. 66 




78. 4% 
6 5,2% 


Strive 
(Max. = 5) 




2. 38 


/ 


40. 5% 


Evaluate 
(Max. - 5) 




2. 1 1 




13,2% 


Total 

(Max. = 36) 




24. 16 

r 




34.4% 
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TABLE 6 

MEAHS FOR PO.STTEST OF SE LF^EVA LUATION . 
LOCU?^ OF CONTROL SCALE, AND SUMMER CAMP TES T 



— % ' 

Measure 


Treatment 




ACT 


Curriculum X 


Control 


Self- evaluation T 


16. 34 


15.84 


IS. 96 


Locus of Control / \ 


1 5. 42 


14.91 


14. 78 


Summer Camp Test \J 


11.73 


10. 88 


11.04 
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TABLE 7 

MEANS FOR VARIABLES IN THE CONNECT THE NUMBERS ClAME 



Variable 


Tr eatm ent \ 




ACT 


Curriculum X 


Control 


Number Correct 


36.-07 


35. 86 


36. 32 


Attainment Discrepancy 


-4. 41 


-3.00 


-Z. 36 


Standard Discrepancy 


1 3. 43 


ZO. 4H 


Z3. 47 


Risk 


3S 


S. 14 


4 .24 
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TABLE 8 ^ ^ 

VARIANCKS I'OR TllF: RI.SK VARIAHLI-: IN 'IIl^ 
CONNECT 'rut: NUMBERS gamp: 



AC 




Curriculuni X 




Coni rol 


10. 08 ■ 



















ERIC 
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TABLE 9 

means'for variables in the scrambled words game 



Variable 


Treatment 




ACT 


Curriculum X 


Control 




Number Correct 


13.22 


13. 00 


13. 52 




Attainment Discrepancy- 


-4. 08 


-3. 27 


-3. 57 




Risk 


3. 67 


2.90^ 


3. 06 




Standard Discrepancy 


3. 19 


4. 7*1 


98 




Prediction 


17. 31 


16.27 


17^1 




Standard 


20. 48 


20.9a . 


22.06 


> 


Sta nda rd- attainment 


7.19 


8. 04 


8. 49 




Discrepancy 
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TABLE 10 

VARIANCES FOR THE RISK VARIABLE 
IN THE SCRAMBLED WORDS GAME 




X 
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TABLE 11 

nuIUerical results of teacher reaction 
to act evaluation interviews 



Tt-acher 


Ql 


Q2a 


Q5a 


Q6 


Ql 


Q8 


Total 


1. 


5 


5 


3 . 




3 


4 


2S 


2. 


4 


4 


2 


5 


5 




25 


3. 


4 


3 


2 


5 


5 


4 


23 


4. 


5 


5 


2 


5 


4 


S ' 


2 A 


5. 


2 


4 


2 


4 


4 


3 


19 


6. 


4 


3 


2 




4 


3 


2G 


, - 7. 


3 


4 


1 


> 


2 




19 


8. ^ 


4 • 


4 


3 




2 . 






9. . 


5 




3 


4 


2 


5 


24 


10. 


5 


4 


3 


5 


4 


5 




11 . 


5 


5 


1 


5 


5 


4 


25 


Av«^ge 


4, 2 


4, 2 


2. 2 


4, 6 


3. ^, 


4. 4 


23.2 



Note. For the average per question. 1 represents the most negative 



possible reaction; 5 is the most positive 'poss ible reaction, and 3 the 
neutral point. For the average total. 6 represents the most negative 
possible reaction; 30 is the most positive possible reaction, and 18 
the neutral point. 



Ql: How do you fe|^l about your decision to involve y^tirself 

and your class in the ACT tryout? 
Q2 If ACT became commercially available, would you^ want to 

use it in your class? 
Q5a: . How did you feel about the time demands of the program? 
Q6: Was the teacher^s manual adequate? 

Q7: Were the training sessions adequate and useful? 

Q8: Did yoii ever'feel the class getting out of your control 

because of the materials? 
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TABLE 12 

AVERAGE STUDENT RESPONSES - . 
TO ACT EVALUATl6iN INTERVIEWS ' 



School 


Ql 


Q2 


Q3 


Q4 


OS 


Total 


I. 


2. 5 


2.8 


2. 5 


2. 5 


2. 5 


12.8 


2. 


3. 0 


3. 0 


2. 5 


2. 3 


2.8 


13. 6 


3. 


2. 0 


3. 0 


1. 8 


2. 0 


2. 3 


.11. 1 


4. 


3. 0 


3. 0 


3. 0 


3. 0 


3.0 


IS. 0 


5. 


2. 3 


2. 5 


1 . 5 


2. 5 


1 . 8 


10.6 


^' 


2. 8 


3. 0 


2. 3 


2. 0 


3. 0 


1 3. 1 


7. - 


2. 8 


3. 0 


2. 5 


2. 0 


2. S 


12. 8 


8. 


2. 3 


3. 0 


2. 0 


2. 5 


2. 5 


12.3 


9. 


2. 3 


2. 5 


2. 3 


2. 3 


2. 5 


1 1 . O' 


Ave rage 


2. 24 


2. 87 


2. 04 


2. 34 


2. 54 


12. 58 



Note. For the average per question, 1 represents a negative reaction. 



3 a positive reaction, and 2 the neutral point. For the average total. 
5 represents the most negative possible reaction; 15 is the niost' 
positive possible reaction, and in is the neut^ral point. 

Ql: How do you feel about having the ACT material in your 

class? 

QZ: If your friend had a choice between taking ACT and not 

taking ACT, what would you advise him to do? 

Q3: Did you learn anything new about yourself in ACT? 

Q4: Have you used the ACT achievement steps outside of 

s chool? 

Q5: Do you think that ACT helped you to achieve any goals 

which, y^ou wouldn't have achieved without it? 
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TABLE 13 

SIGNIFICANT CONTRASTS IN THE ASSESSMENT 
OF ACT EFFECTIVENESS 



Affect / Performance 
Measure 


Ci rou ps 




ACT + Curriculum X 
. vs. Control 


ACT 

vs. Curriculum X 


ACT 
vs. Control 


Self - evaluation 




X 




LiOcus of Control 


X 


X 


X 


Summer Camp 




X 


X 


Connect the Numbers 
Game 

Number Correct 
'Attainment Discrep- 
ancy 
Risk 

Standard Discrepancy- 


X 
X 


X 


X 


Scrambled Words Game 
Number Correct 
Attainment Discrep- 
ancy 
Risk 

Standard Discrepancy 

Prediction 

Stahda rd 

Standa rd- attainment 
Disc r epancy 


i 

X 

X 
X 


X 
X 
X 
X 


X 



Note--(X) indicates where significance was found. 
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I'^igu re Captions 



Figure 1. Student Performance on Selected Itenis from ACT Journals and 
Lesson Tests. 

Figure 2. Percentage of Students Who List a St/iving Method* and 
Four or More Tasks, 

Figure 3. Mean Scores on Summer Camp Test As a Function of Instruction. 

Figure 4. Mean Scores on Locus of Control Shown As a Function of 
Instruction. 

Figure 5. Alean Scores on Self- eva luation ShownAs a Function of Instruction 
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Effect of Instruction 




2 
1 



Preinstruction Postinstruction 



• 


past achievement 




(Unit II. Part 1) 




strengths (Unit III, 




Part 1 ) 


▲ 


goal ideas (Unit fifl , 




Part 2 
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CKcct of InstruLlion 



c 
a; 

3 

o 

OO 
rd 

C 



a. 




Preinstructi'on 



Postinstruclion 



Percentage of students 
who list four or more 
tasks (Unit II. Part 4) 

Percentage of students 
who list a striving ' 
nnethod (Unit II, 
Part 5, Question 2) 



ERLC 



4n 



\ 



f 



16.0 




14.01 

Preinst ruction Post instruction 
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